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SECTION  1  -  INTRODUCTION 


Under  Contract  F2361 3-77-D-OOl I  AFCC  SETA  Task  81-3,  Computer  Sciences 
Corporation  (CSC)  has  performed  an  analysis  of  all  available  Air  Force 
Automated  Message  Processing  Exchange  (AFAMPE)  performance  characteristics 
document at  ion  of  the  Scott,  Sembach ,  and  Ramstein  Air  Force  Bases.  The 
results  of  this  analysis  identify  performance  and  throughput  criteria  for  the 
AFAMPE.  These  criteria  will  be  used  to  establish  the  tests  that  are  applied 
to  AFAMPE  configurations  as  the  "most  severe  load"  conditions.  Section  2  of 
this  docunent  addresses  the  performance  analysis,  and  Section  3  addresses  the 
applied  testing  methodology. 
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SECTION  2  -  PERFORMANCE  ANALYSIS 


2.1  GENERAL 

To  assure  the  total  success  of  noar-t  »*  r  m  APAMI'F.  i  nsfnl  lat  ions  in 
extraordinarily  diverse  and  dynamic  user  environments,  the  Phase  IV  Project 
Management  Office  (PMO)  tasked  CSC  to  analyze  documents  and  determine 
performance  criteria  for  the  most  severe  load  conditions.  In  contrast  to 
functional  criteria  that  identify  the  standard  for  what  the  AFAMPE  must  do, 
the  performance  criteria  identifies  the  standard  of  AFAMPE  execution. 

Various  documents  (referenced  in  Paragraph  2.1  of  the  Task  Statement  of  Work) 
relating  to  system,  message,  and  line  block  loading  were  provided  to  CSC  as 
inputs  to  the  task.  From  this  information,  initial  criteria  have  now  been 
established  against  which  to  measure  the  AFAMPE  performance.  The  remainder  ol 
this  section  describes  how  these  criteria  were  developed. 

2.2  DERIVATION  OF  PERFORMANCE  CHARACTERISTICS 

To  support  the  analysis  and  determination  of  performance  criteria,  the  data 
supplied  by  the  Phase  IV  PMO  was  ordered  in  a  matrix  of  columns  ana  rows.  The 
rows  represent  the  local  topology  or  connectivity  of  the  AFAMPE.  The  co’uinns 
contain  progressive  extrapolations  of  the  topology  workload  from  Raw  Data 
through  Raw  Data  Plus  'J'  Factor,  Raw  Data  Plus  'J1  Factor  Plus  Growth,  and 
Line  Capacity.  In  some  cases,  the  original  data  was  adjusted  to  reflect 
accurately  the  line  throughput  capabilities  of  a  real-time  communicat i ons 
system.  These  adjustments  are  identified  as  notes  to  Tables  2-1  through  2-4 
where  required.  In  all  cases,  a  30-day  month  was  used  as  the  baseline  to 
derive  average  hourly  line  block  load. 

2.2.1  Raw  Data 

The  Raw  Data  column  reflects  present  or  projected  line  blocks  per  hour  traffic 
loads.  The  Average  Hour  subcolumn  for  Raw  Data  was  computed  by  dividing  the 
average  monthly  line  blocks  for  a  given  circuit  by  720  (monthly  hours 
available).  It  the  monthly  load  was  not  provided,  figures  from  similar 
circuits  were  substituted.  In  the  case  of  some  Sembach  circuits,  hourly 
averages  were  computed  by  assuming  (after  analyzing  other  AFAMPE  circuits)  a 
circuit  rate  use  of  25  percent  of  effective  line  capacity. 
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Table  2-1.  Scott  AFAKPE  (1  of  3) 
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Table  2-1.  Scott  AFAMPE  (2  of  3) 


Table  2-1.  ScoCt  AFAMPE  (3  of  3) 


The  "RAW  AVERAGE  HOUR"  was  derived  by  dividing  the  provided  monthly 
statistics  bv  720  (monthly  hours).  This  quotient  was  then  derived  by  3 
(AUTODIN  circuits). 

Where  tributary  data  was  provided  we  divided  the  monthly  figures  by  720 
(monthly  hours).  Where  data  waa  not  provided,  we  substituted  figures 
from  like  circuits. 

The  "AVERAGE  HOUR"  for  Future  Requirement  Circuits  were  derived  by 
computing  an  average  for  like  circuits. 

The  KVDT  statistics  for  "LINE  CAPACITY'’  (SEND)  have  been  fixed  at  225 
line  blocks  per  hour.  Rationale: 

60  WPM  x  5  (character-*  per  word)  *  300  CPM 

300  CPM  x  60  (minutes  per  hour)  K  18,000  character  per  hour 

18000  divided  by  80  (characters  per  line  block)  *  22?  line  blocks  per 

hour 

The  statistics  for  "LINE  CAPACITY"  (REC)  (150  LPM  printers)  is  fixed  at 
8550  or  line  capacity  whichever  is  smaller. 

150  LPM  ::  60  (minutes  per  hour)  *  9,000 

952  (effective  line  capability)  x  9000  ■  8,550  Line  Blocks  per  Hour 
300  LPM  Printer  =  17,100  or  line  capacity  whichever  is  smaller 
(8550  x  2  -  17,100) 

All  statistics  are  listed  in  line  blocks  per  hour  as  truncated  integers. 
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Sembach  AFAMPE  ( 1  of  3) 
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Stubach  AFAMPE  (2  of  3) 
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Table  2-2.  Sembn-n  AFAMPE  (3  of  3} 


The  ASC  "RAW  AVERAGE  HOUR"  was  derived  by  adding  the  "RAW  AVERAGE  HOUR" 
of  the  SEMBACH  Tributaries  to  the  "RAW  AVERAGE  HOUR"  of  SEMBACK  TCC 
(listed  on  Rarastein  statistics).  Tuis  total  was  divided  bv  2  1'.’  AUTODIN 
circuits). 

Where  tributary  data  was  not  provided,  we  substituted  figures  which  are 
equal  to  25  percent  of  the  effective  line  capacity  (95£  line  speed), 
i.e.,  for  a  1200  baud  circuit,  we  multiplied  maximum  line  capacity  (3900 
LBKS/Hour)  times  951  times  252. 

Tributary  data  that  was  given  in  messages  per  month  were  changed  to  line 
blocks  per  month  by  using  the  formula  "ONE  MESSAGE  EQUALS  33  LINE 
BLOCKS."  This  formula  was  recommended  by  phase  IV  PMO. 

"FUTURE  REQUIREMENT"  circuits  were  derived  by  applying  the  given  growth 
formula  and  the  "RAW  AVERAGE  HOUR"  was  derived  by  finding  in  average  of 
all  50  through  1200  baud  circuits. 

All  statistics  are  listed  in  line  blocks  per  hour  as  truncated  integers. 
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Table  2-3.  Ram3tein  AFAMPE  (1  of  A) 


Table  2-3.  Ramstein  AFAMPE  (2  of  4) 
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Table  2-3.  Ramstein  AFAMPE  (3  of  A) 
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Table  2-3.  Ramstein  AFAMPE  (4  of  4) 


1.  The  ASC  "RAW  AVERAGE  HOUR"  was  derived  by  dividing  the  provided  data  by 
720  (monthly  hours).  To  this  quotient  we  added  the  "RAW  AVERAGE  HOUR" 
for  the  4800  baud,  1200  baud  SRT,  600  baud,  and  75  baud  tributaries.  We 
divided  the  aggragate  by  3  (AUTODIN  circuits). 

2.  AFAMPE  tributary  "AVERAGE  HOUR"  was  derived  by  dividing  the  provided 
monthly  statistics  by  720  (monthly  hours). 

3.  We  multiplied  the  provided  totals  for  the  ASC  times  402  to  compute  the 
AVERAGE  HOUR  for  the  KVDTs  and  printers.  Next  we  divided  the  result  by 
13  (original  13  staff  remotes  as  listed  on  draft  report  of  A001). 

4.  The  "AVERAGE  HOUR"  for  Future  Requirement  Circuits  was  derived  by 
computing  the  average  for  like  circuits.  In  addition  to  the  normal 
circuit  growth  we  made  allowance  for  future  requirements  as  identified  in 
PGA' letter  dated  3  February  1982. 

5.  All  statistics  are  listed  in  line  blocks  per  hour  as  truncated  i -tegers. 
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Table  2-4.  Most  Severe  (3  of  3) 


4800  Baud  ASC  circuits  are  from  Scott. 

4800  Baud  Tributaries  are  from  Scott. 

2400  Baud  KVDTs  and  printers  are  from  Scott.  The  statistics  represent  an 
average  of  those  listed  in  Scott's  listing. 

1200  Baud  SRTs  are  from  Ramsteiu. 

1200  Baud  KVDTs  and  printers  are  from  Ramatein.  The  statistics  represent 
an  average  of  those  listed  in  Ramatein’ s  listing. 

75  Baud  Mode  II  Tributaries  are  from  Sembach.  The  statistics  represent 
25  precent  of  effective  line  capacity. 

All  statistics  are  listed  in  line  blocks  per  hour  as  truncated  integers. 


2-14 


To  derive  the  Busy  Hour  subcoiumn  figures,  three  cornputat  ionu  1  approaches , 
described  as  follows  were  evaluated. 


1-  A  constructed  approach  based  on  experience  with  current  service 

AMPEs,  Automatic  Digital  Network  I  (AUTODIN  I),  and  familiarity  with 
data  provided  by  the  PMO. 

AHLB  x  HA  x  73  PERCENT  =  Busy  Hour 
Weekly  Busy  Hours 


where  AHLB 


Average  Hourly  Line  Blocks 


HA  “  Hours  Available  in  One  Week  (168) 


75  Percent 


Weekly  Busy  Hour 

Example:  AHLB  =  29 

HA  =  168 

Weekly  Busy  Hours  "  70 
Therefore: 


75  percent  of  the  weekly  message  traffic  is 
processed  in  five  (Monday  through  Friday),  14 
hour  periods  (usually  0900  to  2300  local  hours). 

70  (14  Daily  Hours  Times  5) 


29  x  168  x  .75  -  52.2 

70 


2.  An  approach  based  on  an  industrial  telecommunications  community 
practice  for  deriving  Busy  Hour  where: 

Busy  Hour  Line  Block  =  (AHLB  x  80%)  +  AHLB 
Example:  AHLB  ”  29 


Therefore: 

29  x  1.8  -  52.2 

3.  An  approach  based  on  Defense  Comminicat ion  System,  Traffic 

Engineering  Practices  (DCS  -  TEP)  Volume  XII,  Sub  Sec  502,  Appendix 
H,  November  1970,  which  defines  Busy  Period  ns  follows: 
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Busy  Period  is  equal  to*2  busy  hours;  therefore,  to  find  a  busy  hour 
the  following  must  be  applied: 

AHLB  x  24  hours  x  14.29 Z  “  Busy  Hour  Line  Blocks 
2 

Example:  29  x  24  x  14.29%  3  49.7  Busy  Hour  Line  Blocks 

2 

As  shown,  all  three  approaches  result  in  a  relativly  close  range.  In  view  of 
the  nunber  of  computations  that  were  necessary,  the  1.8  factor  was  applied  to 
AHLB  as  a  convenience  to  derive  Busy  Hour  figures.  CSC  feels  that  the  use  of 
the  fermila  giving  the  higher  busy  hour  projection  is  sound  and  realistic  in 
relationship  to  the  continued  growth  of  relative  telecommunications. 

2.2.2  Raw  Data  Plus  'J'  Factor 


The  next  column  is  identified  as  Raw  Data  Plus  ‘ J '  Factor.  The  "J"  factor 
incorporates  a  management  reserve  into  the  final  criteria  to  ensure  that 
adequate  processor  capacity  will  be  provided.  This  was  computed  by 
multiplying  the  Average  Hour  of  the  Raw  Data  field  times  1.25  to  give  the 
Average  Hour  for  the  Raw  Data  Plus  'J'  Factor  field. 


Raw  Data  Raw  Data  and  J  Factor 

Avg  Hour  Busy  Hour  Avg  Hour  Busy  Hour 

Send  Rec  Send  Rec  Send  Rec  Send  Rec 

4195  4738  7551  8528  5233  5922  9437  10659 


Busy  Hour  was  computed  by  multiplying  the  Average  Hour  by  1.8. 


2.2.3  Raw  Data  Plus  1 J'  Factor  Plus  Growth 


The  third  column  is  labeled  Raw  Data  Plus  'J'  Factor  Plus  Growth.  The  Growth 
factor  allows  for  normal  growth  in  traffic  volume  over  the  life  span  of  the 
communications  processor,  usually  considered  to  be  8  years,  and  was  agreed 
upon  during  discussions  with  the  PMO.  The  Average  Hour  of  the  Raw  Data  Plus 
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’ J *  Factor  column  was  multiplied  by  1.33  to  arrive  at  the  Average  Hour  for  the 
Raw  Data  Plus  'J1  Factor  Plus  Growth  field. 


Example : 


Raw  Data  Plus  J  Factor 
Avg  Hour  Busy  Hour 
Send  Rec  Send  Rec 


Raw  Data  Plus  J  Factor  Plus  Growth 
Avg  Hour  Busy  Hour 

Send  Rec  Send  Rec 


5243 


5922 


9437 


10659 


6973 


times  1.33 


times  1.33 


7876 


12551  14176 

1.8 

timo3  1.8 


Once  again,  Busy  Hour  was  computed  by  multiplying  Average  Hour  times  1.8. 


2.2.4  Line  Capacity 

The  fourth  column  is  labeled  Line  Capacity.  It  represents  the  eifective 
circuit  throughput  and  is  measured  in  line  blocks  per  hour.  It  is  computed  by 
using  the  formula. 


Circuit  baud  rate  x  hourly  seconds  x  9r>  percent 

Line  Blocks  Bits 


Eifective  Line  Capacity 
Line  Blocks 


where : 

Circuit  Baud  Rate  *  self  explanatory  (i.e.,  1200  baud) 

Line  Block  Bits  *  800  (80  characters  per  line  block  times  10 

bits  per  character) 

NOTE:  Line  blocks  as  received  at  the 
processor  from  the  Terminal  Line  Controller 
(TLC)  do  not  have  framing  characters  but  do 
have  character  start  and  stop  bits.  Hence, 
we  use  10-bit  characters  and  80-character 
line  blocks. 

Hourly  Seconds  =  3600  (60  j;  60) 

95%  “  Detense  Communications  Agency  (DCA)  Standard 

for  circuit  efficiency 
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1 


Exanjile:  Circuit  Baud  Rate  "  1200 

Line  Block  Bits  =  800 

1200  x  3o00  y  .95  *  5130  Line  Blocks  Per  Hour 

800 

Finally,  allowances  were  made  for  circuit  expansion  to  support  new 
communications  requirements.  Circuit  growth  was  established  by  incrementing 
the  number  of  circuits  in  the  following  manner: 

1.  For  4800  Baud  -  increase  by  15  percent  or  i  circuit,  whichever  is 
greater 

2.  Fot  2400  Baud  -  increase  by  25  percent  or  2  circuts,  whichever  is 
greater 

3.  All  others  -  increase  by  33  percent  or  3  circuits,  whichever  is 
greate  r . 

2.3  SITE  PERFORMANCE  ANALYSIS 

The  site  performance  analyses  are  shown  for  Scott,  Sembach,  and  Ramstein  Air 
Force  bases  as  Tables  2-1  through  2-3,  respectively.  The  most  severe 
requirements  have  been  abstracted  from  each  site  analysis  and  consolidated 
into  one  report.  These  consolidated  requirements  are  contained  in  Table  2-4. 
They  will  be  used  as  the  baseline  criteria  when  formulating  the  test  to 
determine  performance  capabilities  of  the  AFAMPE.  The  use  of  this  iiifc  rmation 
is  further  discussed  in  Section  3,  Test  Methodology. 
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SECTION  3  -  TEST  METHODOLOGY 


3.1  GENERAL 

CSC  recognizes  the  importance  of  establishing  a  sound  methodology  to  ensure 
that  the  AFAMPE  can  meet  current  and  future  performance  requirements.  The 
approach  to  this  critical  process  is  discussed  under  the  following  headings: 

1.  Development  of  a  Performance  Test  Plan  (PTP) 

2.  Throughput  Analysis 

3.  Performance  Testing 

4.  Development  of  a  Management  Plan. 

3.2  PERFORMANCE  TEST  PLAN  (PTP) 

CSC  will  produce  a  PTP  that  measures  the  AFAMPE  system's  capability  to  satisfy 
the  performance  requirements  identified  in  Tables  2-1  through  2-4  and  as 
further  discussed  in  Paragraphs  3.3  (Throughput  Analysis)  and  3.4  (Performance 
Testing).  Test  scenarios  will  be  designed  to  ensure  that  the  same  test,  when 
applied  multiple  times,  produces  the  same  basic  results.  The  PTP  will: 

1.  Provide  guidance  for  management  and  describe  the  technical  effort 
necessary  throughout  the  test  period 

2.  Provide  an  orderly  schedule  of  events,  the  methodology  of  testing, 
and  a  list  of  material  to  be  delivered 

3.  Provide  written  requirements  for  the  actual  test  inputs  that  exercise 
the  system's  capability  at  the  different  levels  of  throughput  for  the 
average  hour,  busy  hour,  and  peak  10-minute  intervals 

4.  CSC  will  develop  recommended  pass/fail  criteria  for  each  testing 
phase . 

3.3  THROUGHPUT  ANALYSIS 

Throughput  analysis  deals  with  individual  circuit  types  and  measures  the 
capacity  of  a  particular  circuit  type  without  regard  to  other  activity  in  the 
system.  The  results  provide  for  absolute  comparisons  with,  and  measurements 
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of,  degradation  during  later  pertoiraance  testing.  For  exanple,  it  is 
necessary  to  know  how  much  traffic  can  be  passed  across  the  multiple  AUTODIN 
circuits  by  the  AFAMPE  without  competing  activity.  Throughput  analysis  will 
measure  this  activity.  However,  these  same  circuits  will  be  sampled  in  the 
performance  testing  phase  to  ascertain  throughput  degradation.  The  unit  of 
measure  will  be  line  blocks  per  hour  (LBH).  During  individual  circuit 
testing,  acceptance  is  defined  as  the  ability  to  pass  traffic  at  98  percent  of 
the  line  capacity;  e.g.  ,  98  percent  capacity  for  a  4800-baud  circuit  is  20744 
LBH. 

3.4  PERFORMANCE  TESTING 

The  AFAMPE  must  be  exercised  under  various  load3  to  measure  its  capacity  to 
handle  average  hour,  busy  hour,  and  peak  10-minutc  traffic  loads.  CSC  will 
quantify  the  evaluation  in  addition  to  merely  stating  whether  the  system  can 
or  cannot  meet  the  most  severe  criteria.  To  ensure  this  evaluation  is 
realistic,  the  following  items  must  be  considered: 

According  to  the  documentation  provided,  the  present  AFAMPE  testbed  has  access 
(for  testing  purposes)  to  the  following: 

1.  Two  -  4800-baud  Mode  I  circuits  into  Tinker  AUTODIN  Switching  Center 
(ASC) 

2.  One  -  World  Wide  Military  Command  and  Control  System  (WWMCCS) 
terminal  at  Scott  AFB  (1  -  4800-baud  REC  and  1  -  4800  SEND  circuits) 

3.  One  -  2400-baud  Mode  I  terminal  (either  a  Standard  Remote  Terminal 
ISRT),  Data  Communication  Terminal  (DCT9000)  or  UNI 

4.  Two  -  Mode  II  50-baud  terminals 
3.  Two  -  Mode  II  75-baud  terminals. 

NOTE:  If  both  ASC  circuits  are  active,  the  2400-baud  circuit  cannot  be 

active.  Only  two  Mode  I  circuits  can  be  active  during  a  gi'en 
per iod. 

Patently,  the  present  AFAMPE  testbed  cannot  be  exactly  configured  to  duplicate 
any  of  the  sites  being  modeled.  The  PMO  has  informed  us  that  the  following 
devices  are  or  may  be  available  during  the  test  phase: 
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1.  Two  -  Dynatest  machines  which  can  simulute  Mode  11  interlaces 

2.  Possible  use  of  a  Perkin  Elmer  7/32  as  a  software  driver  into  the 
324  2. 

Because  additional  simulation  devices  are  unlikely,  the  performance  t"st°  will 
be  structured  carefully  to  utilize  available  devices  to  satisfy  the  test 
requirements. 

It  is  highly  unlikely  10  consecutive  days  of  test  time  will  be  available  at 
the  Air  Force  Comrainications  Computer  Programming  Center  (AFCCPC)  testbed  due 
to  scheduling  conflicts.  Accordingly,  the  test  scenarios  will  be  developed  to 
allow  a  multiphased  testing  process  that  will  be  accomplished  concurrently 
with  the  3242  system  development.  The  scheduling  of  these  phases  will  be  by 
mutual  agreement  of  the  PMO,  CSC,  and  AFCCPC  test  facility.  They  are  as 
f  o  1 1  ow  s : 

1.  PHASE  I:  AFCCPC  personnel  will  exercise  selected  scenarios  during 
different  stages  of  system  development.  The  results  will  be 
maintained  for  later  analysis  and  verification. 

2.  PHASE  II:  Selected  scenarios  from  previous  tests  will  be  exercised 
and  matched  against  previous  results  to  ensure  tes1  integrity.  Cnee 
accomplished,  additional  scenarios  will  be  applied  to  ensure 
individual  site  performance  requirements  as  shown  in  Tables  2-1 
through  2-3  are  met.  This  testing  will  be  performed  by  the  test  team 
in  the  presence  of  the  Tost  Director  and  with  CSC  personnel 

ass  istance . 

3.  PHASE  III:  Once  acceptable  results  have  been  obtained  from  the  Phase 
II  process,  the  AFAMPE  will  be  tested  to  meet  the  performance 
requirements  as  shown  in  Table  2-4.  This  final  set  of  scenarios,  if 
successful,  will  provide  a  level  of  assurance  for  future  growth  of 
the  AFAMPE  not  presently  envisioned. 

3.5  MANAGEMENT  PLAN 

CSC  wili  develop  a  test  management  plan  which  will  become  part  of  the  PTP. 

The  management  plan  will  include  the  following: 
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1.  Test  Schedule  -  A  schedule  of  events  associated  with  the  PTP 

2.  Definition  of  Responsibility  -  The  responsibilities  of  each 
organization  participating  in  the  test  will  be  clearly  defined 

3.  Controls  -  Procedures  will  be  established  which  will  allow  the  test 
team  to  exercise  precise  control  over  the  test  procedures  and  the 
authority  to  correct  any  identified  discrepancies 

4.  Reporting  Requirements  -  Required  reports  will  be  identified  with 
responsible  organization.  Additionally,  the  required  forms  to 
support  the  entire  test  plan  will  be  identified. 
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